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ABSTRACT 

Theoretical results that enable rigorous statements of convergence and exponential stability of 
Galerkin approximations of LQR controls for infinite dimensional, or distributed parameter, sys- 
tems have proliferated over the past ten years. In addition, extensive progress has been made over 
the same time period in the derivation of robust control design strategies for finite dimensional 
systems. However, the study of the convergence of robust finite dimensional controllers to robust 
controllers for infinite dimensional systems remains an active area of research. In this paper we 
consider a class of soft-constrained differential games evolving in a Hilbert space. Under certain 
conditions, a saddle point control can be given in feedback form in terms of a solution to a Riccati 
equation. By considering a related LQR problem, we can show a convergence result for finite 
dimensional approximations of this differential game. This yields a computational algorithm for 
the feedback gain that can be derived from similar strategies employed in infinite dimensional 
LQR control design problems. The approach described in this paper also inherits the additional 
properties of stability robustness common to game theoretic methods in finite dimensional analy- 
sis. These theoretical convergence and stability results are verified in several numerical experi- 
ments. 
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(1) INTRODUCTION 


During the past ten years, significant progress has been made in the derivation of convergence cri- 
teria for Galerkin approximations of linear quadratic regulator control problems in Hilbert spaces 
[Banks, Gibson79,Gibson91,lto90...]. Usually, these methods synthesize classical results on the 
convergence of Galerkin approximations for elliptic, hyperbolic and parabolic partial differential 
equations with minimization strategies for convex cost functionals. During the past few years, 
however, researchers studying control theory have been increasingly interested in the derivation of 
control schemes that are robust with respect to uncertainty, either structured or unstructured, in the 
underlying model [McFarlane,Maciejowski ]. 

One approach that has been employed with success in the development of finite dimensional con- 
trollers is the min-max, or soft-constrained differential game, formulation [Basar], In this class of 
techniques the “best” controller is sought subject to a “worst case” disturbance. Extension of this 
approach to infinite dimensions has also been made recently in principle [ Curtain]. However, the 
arguments regarding the convergence of the associated finite dimensional Riccati approximations 
can be more delicate than in the similar LQR minimization case [Attouch.Cavazzuti], 

In this paper we show that, in certain cases, the solution to the min-max problem is equivalent to 
the solution of a related LQR minimization problem. In these cases the approximation theory for 
the LQR minimization problem [ Gibson79,Gibson91,Ito90...] can be brought to bear, and the so- 
lution of the min-max problem can be approximated by a sequence of solutions to finite dimen- 
sional Riccati equations. Thus, this gives a computational method for obtaining a feedback control 
for a class of infinite dimensional problems which is both optimal and robust with respect to un- 
certainty. 


(2) PROBLEM STATEMENT 

Let H, U and W be real, separable Hilbert spaces and suppose that B e L(U, H) and O e L (W, H) 
are bounded operators. 


Consider the evolution equation on H 

jc(0 = Ax(t) + Bu (f) +d>w(0 

x(0) = x 0 e H is given 


( 2 . 1 ) 


where A is the infinitesimal generator of a strongly continuous exponentially stable semigroup S(t) 
on H. In the following discussion, it is assumed that the initial point x(0) is fixed. Furthermore, it 
is assumed that one can define the observation from the state via the relationship 

y(t) = Cx (/) 

Ce L(H,H) ( 2 - 2 ) 
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The optimal control problem to be considered is the infinite dimensional version of the so-called 
“soft-constrained differential game” as described, for example, in [Basar]. This problem can be 
stated by first defining the “disturbance-augmented” cost functional 


J(u,w) = Ijo {||y(0||i+ (Nu(t),u(t)) u -±(Mw(t),w(t)) w }dt (2.3) 

where Y € SR is a fixed positive constant, and N e L(U, U ) , M e L(W, W) . 

Define the spaces U = L 1 ( O, U) and W = L 2 (O, HO . The differential game to be solved 
is to find 


j inf_ sup_j 
ue U we W 

subject to dynamics governed by (2.1)- (2.2). 

A solution (u°, w°) is called a saddle point of J(u,w) if and only if 

J ( m°, w) <J(u°,w°) <J(u,w°) 
V(m, w) e UxW 


(2.4) 


(2.5) 


Roughly speaking, the problem to be solved consists of two parts: 

(PI) Find conditions that are applicable to a reasonably large class of problems 
for which there exists a unique saddle point solution 

(«°,w°) € UxW, 

and such that the solution is given in feedback form. 

(P2) Find a method for constructing a sequence of finite dimensional approximations 
whose feedback solutions converge to the solution of (2.4). 

Next, we discuss conditions under which PI and P2 can be solved. 
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(3.) CHARACTERIZATION OF A SOLUTION 

We make the following assumptions (which we will show guarantee that there exists a unique sad- 
dle point value to the differential game outlined above): 

(HI) There exists d { >0 such that (Nu,u) y>d,||H||y for all ue U 

(H2) There exists d 2 >0 such that (Mw,w) w >d 2 \\w\\ yy for all weW 

( H3 ) BN~ l B* -y^Ar'O* >0 


Conditions HI and H2 are necessary to ensure invertibility of TV and M. Condition H3 is necessary 
for the characterization of the saddle point in feedback form, and for the arguments for conver- 
gence of finite dimensional approximations. While condition H3 is somewhat strong, the assump- 
tions above are applicable to a wide variety of distributed parameter control problems and are 
extremely convenient for consideration of the convergence of finite dimensional Galerkin approx- 
imations. (In a future manuscript we will report on structures application for which H3 is not sat- 
isfied, and on our efforts to relax this assumption). 

Before stating the main existence and uniqueness result, we consider a reformulation of the state 
equation. Define the space H — L (0, °°j H) and observe that a homogeneous (zero initial data) 
version of (2.1) is given by 

Ajc = Bu + Ow 


Here the operator A is defined on the domain 

dom A = (xe H ^-Axe H, x(0)= 0} 


by 


Ax (0 = ^-/U(/), 


and Be L(U,H) , and O e L(W, H) are multiplication operators given by 

(Bu) (0 = Bu(t ) 

(Ow) (0 = Ow(0 

We also define the multiplication operators C e L(H,H ) , Ne L(U,U) and M e L(W,W) j n 
the obvious way. In this paper we frequently will not distinguish between an operator (such as C ) 
and the corresponding multiplication operator (C ) when it is clear from the context which operator 
is used. 

With these definitions, the variation of constants form of the solution to (2.1) can be 
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given by 


x = A i Bu + A l Ow+/ (3.1) 

where f=S(t)x Q . Here, A -1 e L (H, H) is defined by A~ l x(t) = f' S(t-s)x(s)ds . 
Hence, the differential game is to find JO 


in/ 

u e U w e Vf 


7(«, w) 


subject to (3.1). 

Theorem (3.1): Suppose that conditions (HI), (H2) and (H3) hold. Then there exists a unique 

(u°, W°) € Ux W 


such that 


J - in f 

J o ~ 


u 


U 


sup J(u, w) =J(u°, w°) 
we W 


Moreover, (u®,w°) is given by 


w°(t) =y 2 M~ l <k*nx°(t) 
u°(t) =-N~'B*nx 0 (t ) 


(3.2) 

(3.3) 


where 


x° = A~ l Bu° + A~ l G>w° +f 

Here n is a positive definite solution of the algebraic Riccati equation 

(n^y) // + Olj«:,ny) // + (C Jt Cjc,y) w -(nQQnjc,y) // = 0 

for any x,y e D (A) cz H where 


(3.4) 


0 = [BN~ l B* -^OAr'a)*] 1/2 >0 


Observe that (H3) guarantees that 

Q= [BN~ X B* -^OArV] 1/2 


is well defined. Since Equations (3.2), (3.3), and (3.4) relate the saddle point to the algebraic Ric- 
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cati equation, we can apply known methods and techniques for approximation of Riccati equations 
to this problem. 

The proof of Theorem (3.1) is developed through a sequence of lemmas. (We are using notation 
and definitions from [Zeidler]). 


First, recall that for each fixed (u,w), the G-derivative of J(u,w) with respect to u, denoted by 
J u (u,w), is defined by 


U u (u,w),x ) 0 = lim 


J(u + tx,w) -j(u, w) 


( 3 . 5 ) 


Similarly, the G-derivative J w (u,w) of J(u,w) with respect to w is given by 


J(u, w + ty) -J(u,w) 

(J (u,w),y)— = lim 

Vlt ' v / W t -> o t 


( 3 . 6 ) 


for any y € W. Also, 


(J u (w, w) , —J w (u, w) ) e UxW 


and for any (x, y) e Ux 1/1/, we have 

((J u (u>w)’-J w (u,w)), (*>y)) jj x w~ (J u (u,w),x) -+ (~J w (u,w) ,y) - 

Recall also that if X is a Hilbert space, then an operator T (which may not be linear) from X to X 
is called strongly monotone if there is a fixed positive number d such that 

{rx l -rx 2 ,x l -x 2 ) x >d\\x l -x 2 \\ 2 x 

for any x v x 2 e X. The following lemma gives some nice properties about G-derivatives of 
J(u,w). 

Lemma 3. 1: If (H j) and (H 2 ) hold, then the following are true. 

i) for fixed we W, J u (u, w) is strongly monotone on J. 

ii) for fixed u e U, and sufficiently small Y 2 , -J w is strongly monotone on W. 

iii) for sufficiently small Y 2 , (J u , is strongly monotone on UxW. 
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Proof: By direct computation using (2.3) we have 


J(u,w ) = ^(Du,u ) - + (u,Gw + Ff) - + Q(w,f) 

where 

D = N+B* (A -1 )* C* CA~ l B 
G = B* (A _1 )*C* CA _1 <I» 

F = B* (A -1 )* C* C 

G(w,/) = (CA" 1 <l>w,y)^-^(Mw,w)-+i(CA- | Ow,CA- 1 <Dw) s + 

According to (3.5), we obtain 

J u (u,w) =Du + Gw + Ff 

Therefore, for any u 2 e U , and fixed we Id/, it follows from (HI) that 

(•/„(«!, w) -J u (u 2 , w), u { -u 2 ) - = (D(u, — m 2 ) , -« 2 )^ 

> {N(u l -u 2 ),u { -u 2 )->d l \\u l -u 2 \\ 2 - 
Hence, i) is true. Similarly, we can write 

•/(«, w) = -i(D'w,w)-+ (w,G*u + F/)- + Q’(«J) 

where 

D' = (A _, )*C*CA _, <I> 

r 

G* = adjoint of G = <J>* (A -1 ) C*CA~^B 
F' = d>* ( A -1 )* C* C 

^ ( (W + 6* (A- 1 ) V CA-'B) «, «) y + | (C/, C/) -+ (CA- 
Hence, from (3.6), we have 


(3.7) 


l««i 


(3.8) 


(3.9) 


‘Bu, Cf)" 
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(3.10) 


J w (u, w) = -D'w + G* u + F'f 
For any w,, vv 2 6 W and fixed ue U , it follows from (H2) that 

(-J W (U,W { ) +J w (u,W 2 ),W l -W 2 )-= 

= ^ (M(w, -w 2 ), w, -w 2 )_- (CA^Ofw, -w 2 ), CA-'Ofw, — w 2 ))- 


Therefore, for sufficiently small y 2 , there is a positive constant </ so that 

(- J w (u, w { ) + J w {u, W 2 ) , w, - W 2 ) _ > </|| w, - W 2 j| 2 _ 


Thus, ii) is verified. Finally, for any (Wj, w,), (u 2 ,w 2 ) e L/x W and sufficiently small y 2 , it 
follows that , 

((•M m 1 ’ VV 1 ) -J w ( u V w |)) - ( y u ( U 2 > " 2 ) -^( M 2 > w 2 ))’( M l’ W l) - (W 2 > M ' , 2 )> Dxt y 

= (•/„(“!> H>,) -•/ tt («2’ W '2)* U l- M 2) r , + +- / H-( M 2- W 2)> W 1- W, 2)- 

= (D(m,-m 2 ) + G(w, -w 2 ), u, -u 2 ) + (D’(w 1 -w 2 ) -G* (m 1 -u 2 ),w,-w 2 ) _ 

U yy 

= (D(«,-m 2 ),« 1 -m 2 )-+ (0 , (« 1 -m 2 )» w i“ m; 2)^ 

+ (C(w,-w 2 ),« l -« 2 )- - (G* (m 1 -m 2 )’ w i- vv 2)^ 

= (D(w, -M 2 ),« 1 -M 2 )-+ 

^^l||“l -“2||^- + -^II VV 1 - W 2|||^ 


Hence, this lemma is completed. 

The existence and uniqueness of a saddle point of J(u,w) are illustrated in the following lemma. 
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Lemma 3.2: Assume that (HI) and (H2) hold. There exists 0 Q > 0 such that if 0 < y 2 < 0 Q , then 
J(u,w) has a unique saddle point. 

Proof: Clearly J(u,w) is continuous with respect to u and w. Further, it follows directly from (3.7) 
and (3.9) that for sufficiently small y 2 * 

i) u J (u, w) is convex for each fixed w e W , 

ii) w — > -J (u, w) is convex for each fixed u e U , 

iii) J(u,w) -» °o 35 ||u|| — > oo for each fixed w e W, 

iv) -J (u, w) -4 oo as II w|| -» «> for each fixed ue U . 

The result follows from Theorem 1.1 in [Bensoussan], 

The following result characterizes the saddle point. 

Corollary 3.1: (u®,w°) is the saddle point of J(u,w) if and only ifJ u (u Q ,w°)=J w (u°,w Q )=0. 

Proof: See [Zeidler], p. 467. 

The next result gives a further characterization of the saddle point. 

Lemma 3.3: Let 


u°(t ) = -ArV (A _1 )*C*Cx°(/) 

(3.11) 

w° (/) = r x d>* (A _1 )*C* Cjc°(0 

(3.12) 


where jc° (r) = A l Bu°(t)+ A 'Ow 0 (/) +/. Then (u®,w®) is the unique saddle point of 
J(u,w). 

Proof: From corollary 3.1, we only need to check that 

J u (u°,w°) = J w (u°,w ° ) = 0 

where u°,w° are given by (3.1 1) and (3.12). In fact, applying (3.8), we have 

J u (u°,w°) = (A+B* (A -1 )*C* CAB) (-AT'fl* (A -, )*C* Cx°) 

+ (B* (A -1 )* C* CA -, <I>) (A~')*C*Cx°) + B* (A ~ x )* (? Cf 

= B* (A -1 )*C* C(-jc° + A _1 Bw° + A _, Ow°+/) =0 
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Similarly, from (3.10) we have 

7 («°, vv°) = + (-O* (A -1 )*C* CA _1 0)) (A _1 )*C* Cx°) 

r 

+ (O* (A -1 )* C* CA~ l B) (-AT 1 #* (A~')*C*Cx 0 ) +0* (A ~ 1 )* C* Cf 
= O* (A~ 1 )* C*C(-x 0 + A- l <Pw 0 + A- l Bu°+f) =0 . 

Hence, (u°,w°) is the unique saddle point of J(u,w). 

The following lemma characterizes the saddle point in terms of the solution to an algebraic Riccati 
equation. We note that H3 has not been used until now. 

Lemma 3.4: Assume that (H1)-(H3) hold. Then the unique saddle point («°, w°) of J can be ex- 
pressed as 

u°(t) = -ATVrijtV) 
w°(0 = Y 2 AT 1 O*nx°(0 

where x° (t) = (A ~ l Bu°) ( t ) + (A -1 Ow°) ( t ) +f(t ) , and n is the unique solution of 

the Riccati equation 

(ITr, Ay) -+ (Ax, FIy)- + (C* Cx,y)~- (nn 2 rix,y)^ = 0 

for any x,y& D (A) qH and Q = (BN~^B* — y^OA/^O*) 

Proof: This result follows from [Bensoussan]. 

Therefore, the proof of Theorem 3.1 is completed. 


(4.) CONVERGENCE OF GALERKIN APPROXIMATIONS 

Perhaps one of the most attractive features of the method described in this paper is that the conver- 
gence of the Galerkin approximations of the saddle point solution to the differential game is guar- 
anteed by the rich collection of Galerkin approximation results available from infinite dimensional 
LQR minimization formulations . This is because the solution of the infinite dimensional LQR 
minimization problem 
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inr JZi\czml+\H»\l)d, 

ve H J 


( 4 . 1 ) 


subject to the evolution equation in H 

z{t ) = Az(t) +Qv(0 

z(0)=z 0 eff ( 4 - 2 ) 


is characterized by the same algebraic Riccati equation that solves the differential game of the pre- 
ceding section, namely 

(rLc.Ay)^ + CAx.ny)^ + (C* Cx,y) H ~ (nQ£2rijc,y) w = 0 (4.3) 

With this observation, the idea is to construct finite dimensional versions of (4.1) - (4.3) and then 
to apply known convergence results such as those found in [Ito] and [Kappel, Salamon], To pro- 
ceed, let ( ) ~ = i a family of finite dimensional subspaces of H satisfying 


H = U H n 

n = 1 

We assume that there are operators A„ e L ( H n , H„ ) ,Q„eL ( H„ , H„) ,C n eL ( H n , H n ) and that 
P n is the orthogonal projection from H to H n . 

With these finite dimensional operators and spaces, one can consider the following LQR minimi- 
zation problem: 


vi' , H„Io { l C ” z '.(' ) lH. + lv(') | K } ‘" 

subject to the evolution equation in H n 

Z n (t) = A n Z n t + Q n v(t) (4.2) n 

Zn (0) = o 

The optimal feedback gain for this problem is characterized by a solution to the following algebraic 
Riccati equation: 


a* n + i\A n + c* c„ - nQ q n = o 

n n n n n n 


( 4 - 3 ), 
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If n n and n are the minimal nonnegative solutions of (4.3)„ and (4.3) respectively, then we may 
appeal to results in the distributed parameter control literature ( [Banks & Kunisch], [Gibson91], 
[Ito87,Ito89], [Kappel, Salamon] ) for conditions under which n JP n — > n. The following condi- 
tions can be found in [lto87]. 

(H4) For each x e H,S n (t) P n x -» S (t) x and S* (0 P n x -> S* (/) x, and the convergence 
is uniform in t on bounded subintervals of [0,t]. 

Here, S n ( 0 = exp ( tA n ) is the semigroup generated by A n . Note that at f=0, this 
condition implies that P„x — * x for all x e H. 

(H5) For each x e H, -> Clx, C n P„x Cx and C* P n x -+Cx. 

(H6) The family of pairs (A n , Q^) and ( A n , C n ) are uniformly stabilizable and uniformly 
detectable, respectively. In other words. 


(i) there exists a sequence of operators K n e L (H n , H ) such that 


sup\\K n \\<< 


e (A m -a m K a ), p 


— G),f 

< M.e 1 


r>0 


for some positive constants Mj and (Oj, and 

(ii)there exists a sequence of operators G n e L (H n , H) such that 


su P\\ G n\ 


< CO 


(A-G,,C m )t, 


■" <M^e “ 2 ' 


r>0 


for some positive constants M 2>1 and CO 2 . 


The following result is found in [ Ito] . 

Theorem 2 : Under the assumptions (H4)-(H6), the unique nonnegative solution n n of (4.3) n con- 
verges strongly to the nonnegative solution n of (4.3); that is, 


The point of all this, of course, is that (4.3) n is finite dimensional, and so we can solve for nu- 
merically. This is done in the next section for specific examples. 
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5. NUMERICAL EXAMPLES 


In this section we report on some numerical results for a simple example involving the heat equa- 
tion in a rod. Consider the equation 

y,(t,x) = ay xx (t,x ) + b (x) u (f) + <J> (x) w (t) 0<x< I 

(5.1) 

y(0, x) = y 0 (x) 

with Neumann boundary conditions 

y x (t, 0) = o = y x (t, 1) (5.2) 

In addition, consider the LQR cost functional 

J 0 (U) = Ij~ {l l 0 qy(t,x) 2 dx + N\u(t)\ 2 }dt (5.3) 

and the disturbance augmented cost functional 

/,(«) - ^\Q{\\qy{t,x) 2 dx + N\u{t)\ 2 -^M\\v{t)\ 2 }dt (54) 


We set U = 9?, W = 9?, and consider the following two problems: 


inf_ 

ue U 


J 0 («) 


subject to dynamics governed by (5.1) with <t> = 0, and 

inf SU P j , , 

ue U we W 


subject to the dynamics governed by (5.1). 


(5.5) 


(5.6) 


In our basic numerical experiment, we implement the LQR feed back controller (from (5.5)) in the 
presence of a disturbance, and then do the same for the game theoretic controller (from (5.6)). We 
then compare the performance of the two controllers in the presence of disturbance. Before giving 
some numerical results, we briefly discuss how this problem is reformulated within the framework 
developed earlier. 

First, set H = L 2 (0, \ ) and define the operators B e L (U, H) , <t> e L (W, H) by Bu = b(x)u y 
and <bw = <j>(x)w. In addition, define the operator A on the domain 

dom A = {ye H 2 { 0, 1); y'(0)= /(!)= 0} (5.7) 

by Ay = ay" . 
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Next we introduce Galerkin approximations based on finite dimensional spaces H n with linear 
spline (“hat” functions) shape functions. This leads to the following finite dimensional version of 
(5.1): 

d (0 = A n a (/) + B n u (0 + O'V (r) (5.8) 

a(0) = a 0 

where a (/) e 9?" , and A n , B n , O" are n x n, n x 1 and n x 1 dimensional matrices, respectively. 
We use fl 0 to represent the solution of the finite-dimensional algebraic Riccati equation associated 
with the LQR cost functional 

J n 0 (u) = \~{qa(t) T a(t)+N\u(t)\ 2 }dt 

and n , to represent the solution of the Riccati equation associated with the game theory cost func- 
tional 

J n i(u,w) = {qa(t) T a(t) +N\uU)\ 2 ~^M\w(t) 2 \}dt 


In the figures below we plot the approximation to y (t,x) for several different problems. 

As data for these examples, we used a=l, N=\, M=\, q=\0,y = 0.5,£>(.x) =0.25, <() (x) = -0.35 
and y a (x)= 1 Ox. 

In Figure 1 we plot the open loop solution for the problem 

d(/) = A n a(t) 

In Figure 2 we plot the LQR closed loop solution (no disturbance) for the problem 

a(r) = (A n - AT 1 B" r n o ) a (/) . 

In Figure 3 we plot the LQR closed loop solution (with disturbance term) for the problem 

d(/) = (A n -B n N~ l B nT U 0 )a(t) +<J>"w(/) . 


In Figure 4 we plot the game theory closed loop solution (with disturbance term) for the problem 

d(0 = (A” -fi"A rl 5 ,,r n i )a(r) +O n w'(/) . 

While figures (1) - (4) describe the qualitative nature of the transient response in each of the four 
cases, figures (5)-(8) illustrate an important difference in the examples by taking a cross-section 
in space at x=2/3. The basic observation to be made is that the game theory controller improves 
performance (in the sense of driving the state to the zero equilibrium position) in the presence of 
disturbances. We have performed several such experiments with various parameters (including 
Dirichlet boundary data) and observed qualitatively the same behavior. We are currently applying 
this method to systems involving elastic structures. Preliminary results indicate that an LQR con- 
trolled system may, even worse than performing poorly, become destabilized in the presence of 
disturbance. These results will be reported in a future manuscript. 
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One of the key motivations for the work in this paper is the applicability of the approach 
to uncertain distributed parameter systems. A second numerical example outlined in this section 
has been based on examples in [Rosen], but with the introduction of a region of the structure in 
which the control influence is uncertain. Again, the problem is to find 

oo 

inf__ SU P_ f {(Qy(t) t y(t)) H + N(u(t),u(t)) u - ^(w(t),w(t)) w } dt 
u e U we W * T 


where 


H = L 2 ( 0,1) H = L 2 (0, oo;//) 

U = L 2 ( 0,1) U = L 2 (0,oo-,H) 

W = SK W = L 2 (0, oo;9t) 


The min-max problem stated above is subject to the evolution equation 

(t, x ) = a^y (t, x) + bu (t, x) + <}» (x) w(t) 


y(f,0) = y(t, 1) = 0 for t> 0 
y (0, r») = y°(n) for 0<T|< 1 

where the operator <j) is defined by 


and where a=.25, b=1.0, N=.01, (^=.49, and P 2 =51. Motivated by [Rosen], the operator Q is de- 
fined to be simply the projection onto the first three open loop modes 

3 

(qd (x) = 

; = i 


w(t) 

P2-P1 

0 


P, <*<P 2 

otherwise 


where <?,(*) = ft sin (inx). 

The operator $ represents the “spatially structured” disturbance. In actual applications, the dis- 
turbance could be due to sensor dynamics or structured parametric uncertainty. In either case, the 
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task is to design a finite dimensional controller that is robust with respect to the class of distur- 
bances that can be input by <{>. Figures (9) through (12) depict the transient response of the heat 
equation in the rod where 



is defined to be 0 = 0.5 in this example. The system is clearly exponentially stable, as predict- 
ed by the theory, despite the introduction of disturbance. From [Curtain] and the discussion earlier 
in this paper, one can conclude that the disturbance attenuation of the closed loop transfer function 
from disturbance to input and output is bounded by 

Fc/IL<y 


where 



Even stronger conclusions can be obtained for this particular problem by noting that the entire heat 
equation, including disturbance, can be cast in terms of Hilbert-Schmidt operators as described in 
[Rosen]. The Hilbert-Schmidt norm of the difference between the approximating Riccati equation 
solutions and the actual Riccati equation solution converges to zero. This is demonstrated graph- 
ically in figures (13) through (15) which show the kernels used to represent the Riccati operators. 
The kernels clearly converge as the level of discretization increases. Furthermore, for the small 
value of 0=.OOO1 selected, the Riccati operators should be quite close to the LQR approximations. 
This is, in fact, the case, as can be concluded by comparing figures (13) - (15) with figures (4.1b), 
(4.1c) and (4. Id) of [Rosen]. The Riccati kernels for 0=.5 are depicted in figures ( 1 6)-( 19). 
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Figure (13) Heat Equation Riccati Kernel, N=8, 9=.0001 



Figure (14) Heat Equation Riccati Kernel, N=8, 0=.OOO1 
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Figure (15) Heat Equation Riccati Kernel, N=8, 0=.OOO1 
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Function gain theta=0i n=8 




Figure (17) Heat Equation Riccati Kernel, N=16, 9=.5 
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Function gain thcla=0J n=13 




Figure (18) Heat Equation Riccati Kernel, N=16, 0=.5 




Figure (19) Heat Equation Riccati Kernel, N=32, 0=.5 
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